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Abstract Sustainable societies need a workforce with a 
very creative and flexible nature to be able cope with rapidly 
changing situations making creative and reasonable 
decisions. The only suggested way to obtain this is through 
education that is oriented to competences. The goal of this 
research is to determine the influence of a new 
competence-based science curriculum on gymnasium 
students’ scientific creativity skills and socio-scientific 
reasoning in the context of studying lactose intolerance. In 
order to investigate the development of these skills at the 
gymnasium level, a scientific literacy test is administered to 
1116 10 th grade students (16 -17 year old) and 802 12 th 
grade students (17-18 year old), totally 1918 students in. 44 
randomly selected schools from different regions of Estonia, 
both urban and rural, to the scientific literacy test on a new 
Estonian competence-based curriculum is conducted in the 
fall of 2011 with the 10 th grade students and the test is 
repeated with the same students in the spring of 2013 before 
they graduated 12 th grade. The data are gathered with an 
8-item test assessing students’ scientific literacy components 
including scientific creativity and socio-scientific reasoning. 
The test situation is initiated by a scenario describing an 
expected visit of a family (mother and triplets) and their food 
provision problems, which arise because the mother and one 
of the boys suffered from lactose intolerance. One of the 
tasks is designed to measure scientific creativity skills and 
one task to assess socio-scientific reasoning skills. 
Responses are scored from 0-3 points per task. The results 
of the study show that the new competence-based science 
curriculum has not yet affected significantly the students’ 
learning outcomes in enhancing competences associated 
with scientific creativity and socio-scientific reasoning skills. 
Studies during gymnasium level have not supported the 
students’ ability to transfer biological and chemical 
knowledge into everyday situation effectively. 
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1. Introduction 

During the past few decades there has been much 
international discussion about the need to make changes in 
secondary school science. Two main arguments have been 
put forward to justify change, namely, the decrease in 
student interest in science [1] and the need to broaden the 
curriculum with more emphasis on the competencies and 
transferable skills rather than academic knowledge [2], 

In addition, there is a need for a scientifically literate 
workforce and for citizens who are provided with the 
appropriate skills and knowledge [3, 4, 5]. 

In 2011, Estonia introduced a new competence-based 
curriculum, intended to initiate a paradigm shift from 
memorization of knowledge to competences and transferable 
skills [6], The goals for science education were specified as 
fostering scientific literacy through: problem solving, 
decision making, reasoning and creative thinking skills. This 
study is focused on the development of socio-scientific 
reasoning and scientific creativity skills. 

The role of science education in promoting scientific 
literacy is to offer support for the ideas that innovation 
plays the central role in national success and fostering 
innovation requires a supportive social environment [7]. 
According to Kurt Heller [8] the hypothetical construct 
‘scientific ability’ can be defined as scientific thinking 
potential, or as a special talent for excellence in the (natural) 
sciences. Similar to this definition, ‘scientific creativity’ can 
be conceptualized as individual and social capacities for 
solving complex scientific problems in an innovative and 
productive way. Recently suggested ideas for increasing the 
interest towards learning science, including biology, is 
through making use of socio-scientific issues [9]. 
Socio-scientific issues (SSI) have been proved to be 
effective in developing students’ creative problem solving, 
decision making and socio-scientific reasoning skills [10, 
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11]. The use of socio-scientific issues (SSI) has been 
effective both for engagement of students learning science 
[12, 13] and also for development and measurement of 21 st 
century skills [14] needed for future workforce [15]. 

Although scientific creativity is considered to be crucial 
in solving complex scientific problems, on the other hand 
the most powerful long-range predictors of professional 
success in science are apparently domain specific 
problem-solving abilities, motivation and social leadership 
competences, while general intelligence and creativity tests 
have had the lowest prognostic value [8]. 

Scientific reasoning is an important component within 
cognitive 21st century skills and is highly emphasized in the 
new science education standards [16]. The addition of a 
social component to the reasoning increases the relevance 
of decision making for students as well as fostering their 
divergent approach to socio-scientific decision making and 
its reasoning that includes social aspects. 

With the emergence of increased attention to 
competences required by citizens for a knowledge-based 
society, schools and educational systems around the world 
were called upon to make changes to their curricula [17]. In 
Estonia, the reform in science curriculum was implemented 
in 2011 and one of its important goals was to develop 
students’ scientific literacy, including creative problem 
solving and socio-scientific reasoning of decisions. 

In 2011, Estonia introduced a new competence-based 
science curriculum, intended to initiate a paradigm shift 
from memorization of knowledge to the development of 
competences. The goal for the current research was to 
assess the possible change of students’ scientific literacy 
components in terms of scientific creativity and 

socio-scientific reasoning skills during the operation of a 
competence-based science curriculum. According to this 
goal the following research questions were put forward: 

1. Is the created assessment test generalizable for 

determining the levels of scientific creativity and 

socio-scientific reasoning of Estonian gymnasium students? 

2. Has the competence-based science curriculum been 
effective in increasing the students’ scientific creativity and 
socio-scientific skills? 

This is the first and only study in Estonia to evaluate the 
change of scientific literacy among the students throughout 
the gymnasium studies. 

2. Materials and Methods 

Study design 

This was a longitudinal comparative study for 
investigating the possibility to assess the influence of a new 
Estonian competence-based science curriculum on 
gymnasium level students’ scientific literacy, measured in 
the form of scientific creativity and socio-scientific 
reasoning skills. The scientific literacy test was conducted 
with 1116 10 th grade students in the year 2011 when the 
Estonian new competence-based curriculum was 


implemented and the same test was carried out again with 
802 students after three years in 2013 when the same 44 
schools’ students had reached grade 12. 

Sample 

The research was conducted on a regional representative 
sample of 44 different Estonian schools with 1116 10 th 
grade (boys 519 and girls 597; 16 -17 years old) and 802 
12 th grade (boys 386 and girls 416; 17-18 years old) 
students (N=1918). The study was designed on the basis of 
schools and from different regional lists of schools, every 
4 th was selected to get a random representative sample. 

Instrument 

For measuring the level of scientific literacy of 
gymnasium students, a complex interdisciplinary 
assessment test was designed in the context of lactose 
intolerance and the two above-mentioned skills of scientific 
literacy identified in our framework were a focus of the 
current paper. 

The part of the instrument used for this study was based 
on a socio-scientific contextual situation of lactose 
intolerance that consisted of 8 tasks which presumed the 
abilities of transferring the biology knowledge into a new 
everyday situation. The situation was based on an expected 
visitation of a family (mother and triplets - two boys and a 
girl) and their food provision problems arising because one 
of the boys (and the mother?) suffered from lactose 
intolerance. Two of the tasks were designed to measure the 
following aspects of divergent thinking: (1) scientific 
creativity and (2) socio-scientific reasoning skills. The task 
of scientific creativity asked for possible privileges of 
lactose tolerance for human beings during evolution and the 
different answers were coded as follows: (1) no answer or 
biologically wrong - 0 points; (2) one possible adequate 
privilege - 1 point; (3) two possible adequate privileges - 2 
points; and (4) three or more possible adequate privileges of 
lactose tolerance - 3 points. 

Similar coding was used for the task of socio-scientific 
reasoning, where students were asked to reason their 
decision made about creating or not creating special menus 
for lactose intolerant people in private restaurant: (1) no 
answer - 0 point; (2) just describing the decision - 1 point; 
(3) reasoning the decision from one aspect - 2 points and (4) 
reasoning the decision from two or more aspects - 3 points. 

Data Analysis 

The data analysis was performed with Microsoft Excel 
and IBM SPSS Statistics 22. In addition to descriptive 
statistics (average, percentage), the nonparametric 
Wilcoxon Signed Ranks Test was used to assess the 
statistical significance of differences between groups. In 
case the difference was statistically significant, Cohen's D 
for T-Test (Independent Samples) was calculated, using the 
online Calculator from the Social Science Statistics 
homepage [18] to assess the magnitude of this difference. 
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3. Results and Analysis 

The increase of mean results of students’ scientific 
creativity skills was statistically significant (Z = -7,39, p = 
0,000) and as the size effect was 0,34,it can be considered a 
real increase which could be meaningful in a pedagogical 
sense. The results of the socio-scientific reasoning task 
increased also during the three years of gymnasium studies, 
but this increase was not statistically significant (Z = -1,03, 
p = 0,301). As the mean results were lower than half of the 
maximum points available to achieve, it was obvious that 
the level of scientific creativity and socio-scientific 
reasoning skills were, for majority of students, very low, 
even by the end of gymnasium school. 

The mean results (Table 1) showed that in the 10th grade 
the students’ scientific creativity skills were considerably 


lower than the skills of socio-scientific reasoning but during 
the gymnasium studies, with the new curriculum, the 
scientific creativity and socio-scientific reasoning skills 
levelled off indicating that the new curriculum was effective 
only in one investigated aspect (scientific creativity). 

In comparison of male and female students’ scientific 
creativity and socio-scientific reasoning skills, the girls 
outperformed the boys in both skills within both grades and 
the differences were statistically significantly, although the 
differences had no crucial meaning, as effect sizes (Table 3) 
did not show enough magnitude of this effect. The girls’ 
results of both scientific creativity and socio-scientific 
reasoning skills increased in both grades, while the 12 th 
grade boys’ socio-scientific reasoning skills did not increase 
statistically, or meaningfully. 


Table 1. The difference between the results of scientific creativity and socio-scientific reasoning tasks in 10th and 12th grade students. 



Scientific creativity 

Socio-scientific reasoning 

Increase of 
students’ 

results 

Wilcoxon Signed Ranks Test 

Effect size 
(Cohen’s D) 

Mean 

(SD) 

Mean 

(SD) 

Mean 

z 

Asymp. Sig. 

10 th grade 

1,14 

(0,81) 

1,46 

(0,69) 

0,32 

-10,94 

0,000** 

0,43 

12 th grade 

1,43 

(0,91) 

1,52 

(0,74) 

0,09 

-2,25 

0,025* 

0,07 

Total 

1,26 

(0,86) 

1,49 

(0,71) 

0,23 

-9,56 

0,000** 

0,29 


*Significant difference between the groups at the 0,05 level of confidence 
** Significant difference between the groups at the 0,01 level of confidence 

Table 2. The results of Wilcoxon Signed Ranks Test comparing the 10th and 12th grade students’ scientific creativity and socio-scientific reasoning 
skills. 



Scientific creativity skills 

Socio-scientific reasoning skills 

Wilcoxon W 

987507,5 

1059568,0 

z 

-7,388 

-1,034 

Asymp. Sig. (2-tailed) 

0,000* 

0,301 

Effect size 

0,337 

0,084 

(Cohen’s D) 


* Significant difference between the groups at the 0,01 level of confidence 

Table 3. The difference between the results of scientific creativity and socio-scientific reasoning tasks of male and female students. 



Students Wilcoxon Signed Ranks Test 

Effect size 
(Cohen’s D) 

Male 

Female 

Mean . c . 

difference Z Asymp ' Slg ' 

GRADE 10 

Scientific creativity 

Mean (SD) 

Socio-scientific reasoning 
Mean (SD) 


1,10 

(0,77) 

1,22 

(0,87) 

0,12 

-1,97 

0,049* 

0,146 

1,45 

(0,51) 

1,61 

(0,66) 

0,16 

-2,01 

0,045* 

0,081 

GRADE 12 

Scientific creativity 

Mean (SD) 

Socio-scientific reasoning 
Mean (SD) 


1,28 

(0,61) 

1,45 

(0,74) 

0,17 

-2,31 

0,021* 

0,103 

1,48 

(0,68) 

1,54 

(0,77) 

0,06 

-0,614 

0,539 

0,083 


*Significant difference between the groups at the 0,05 level of confidence 
** Significant difference between the groups at the 0,01 level of confidence 
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Figure 1. The distribution of 10 lh and 12 th grade students’ scientific creativity skills. 
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Figure 2. The distribution of 10* and 12* grade students’ socio-scientific reasoning skills. 


Table 4. The cross tabulation of the results of scientific creativity task and socio-scientific reasoning task. 


Scores 

Socio-scientific reasoning task 

Total No of 

students 

0 

i 

2 

3 

Scientific creativity task 

0 

59 

197 

103 

17 

376 

1 

23 

450 

303 

43 

819 

2 

10 

238 

251 

69 

568 

3 

2 

63 

69 

21 

155 

Total No of students 

94 

948 

726 

150 

1918 


The current study gave a preliminary overview of the 
levels of students’ scientific literacy in two aspects. Table 4 
illustrated that a large number (729) of students stayed at 
lower levels (1 and 2), both in scientific creativity and 
socio-scientific reasoning scores. At the same time, a 
considerably smaller number (410) of students had achieved 
higher scores (2 and 3) in both scientific creativity and 
socio-scientific reasoning tasks. Only 21 students (1,1 %) 


out of 1918 in both components of scientific literacy 
attained maximum results (3 points) and such a result was 
certainly unsatisfactory. 

The Figures 1 and 2 illustrate the detailed changes of 
students’ competences, showing that the distribution of 
students test results followed different patterns: the results of 
the scientific creativity skills distribution moved more 
significantly in the direction of higher scores. The results for 
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the distribution of socio-scientific reasoning skills 
maintained the general pattern, except for the changing 
proportion of the lowest and highest scores. 

4. Conclusions 

Creating and using the assessment instrument, based on 
lactose intolerance, in order to map students’ learning 
outputs from science studies was shown to be suitable for 
measuring students’ scientific creativity and socio-scientific 
reasoning skills and their changes during gymnasium 
science studies. This outcomes was similar to that obtained 
by Zhou et al. [16] who described the effectiveness of task 
context in assessing reasoning skills 

The results of our study indicate that in a similar fashion 
to other previous studies investigating the scientific 
creativity and socio-scientific reasoning skills of students 
[14], there are problems in students’ achievement. Although 
the new competence-based curriculum is intended to 
improve students’ so called 21 st century skills, it is a slow 
process [17]. 

This study showed gender differences in achievements of 
important components of scientific literacy were better 
achieved and developed by female students. Although there 
was a statistical increase, both in scientific creativity and 
socio-scientific reasoning skills of both genders and both 
grades (except 12 th grade male students’ socio-scientific 
reasoning skills), it cannot be considered as a meaningful 
change due to the low magnitude of the statistic. 

As a conclusion, it can be said that the instrument was 
suitable for assessment of scientific creativity and 
socio-scientific reasoning skills. The estimated low levels of 
investigated skills show, like in previous studies [10], which 
fostering scientific creativity and socio-scientific reasoning 
skills are still undervalued in science classes. The new 
curriculum has only been implemented for several years and 
many teachers are not yet prepared to foster these skills by 
purposefully assessing them, even though the curriculum 
has been updated for this purpose. 

The new Estonian curriculum [6], focusing on the 
development of students’ scientific literacy skills measured 
in the aspects of divergent thinking (scientific creativity), 
had a significant effect in scientific creativity skills but not 
a considerable effect on achievement on students’ 
socio-scientific reasoning skills. 

The mean results of the test at the beginning of the 
gymnasium studies showed that the students had obtained 
a moderate level of socio-scientific reasoning skills already 
at lower secondary school and did not evolve further during 
three years of gymnasium level studies. At the same time, 
the scientific creativity skills developed significantly during 
gymnasium studies, as the base from previous studies was 
very low. That’s why it is possible to conclude that the 
focus of the new competence-based curriculum had favored 
the field of scientific creativity which was not purposefully 
developed during the earlier science lessons. Although the 


creativity tests had the lowest prognostic value in 
comparison with other components of scientific literacy (e.g. 
problem solving, etc.), according to literature [8], it was still 
very important in the context of 21 st century skills needed in 
future careers [14]. Unfortunately there was almost no 
positive increase in the pedagogical sense during 
gymnasium studies, in the field of socio-scientific reasoning 
this being more crucial and more highly emphasized in the 
new science education standards [16]. The test results 
illustrate that during three years of gymnasium studies 
developing of scientific creativity skills is more successful 
than the enhancement of socio-scientific reasoning skills but 
as the 12 th grade students’ average score for scientific 
creativity is 1,43 and 1,52 for socio-scientific reasoning 
skills (out of 3) it cannot be considered a satisfactory result. 

The outcomes of the study will be used for developing the 
new external assessment tool in Estonian science education. 


Acknowledgements 

This study has been supported by European Social Fund 
program EDUKO grant LoTeGym and Estonian Science 
Foundation grant GL0L08219. 


REFERENCES 

[1] Ekborg, M.; Ottander, C.; SilAer, E. & Simon, S. (2013). 
Teachers’ Experience of Working with Socio-scientific Issues: 
A Large Scale and in Depth Study. Research in Science 
Education, 43, 599-617. 

[2] Beier, Y. (2014). The collaborative advantage. The rewards 
of a collaborative culture are significant, but so is the effort to 
get there. Communication World, January, 22-25. 

[3] Ravenscroft, A.; Lindstaedt, S.; Kloos, C.D. & 
Hemandez-Leo, D. (Eds.) (2012). 21 st Century Learning for 
21st Century Skills. 7th European Conference on Technology 
Enhanced Learning, EC-TEL2012 Saarbriicken, Germany, 
September 2012, Proceedings. 

[4] European Commission. (2010). Special Eurobarometer 340: 
Science and technology. URL: http://ec.europa.eu/public_opi 
nion/archives/ebs/ebs_340_en.pdf. 

[5] Bybee, R. W. & Fuchs, B. (2006). Preparing the 21st Century 
Workforce: A New Reform in Science and Technology 
education. Journal of Research in Science Teaching, 43(3). 

[6] Estonian Curriculum. (2011). National Curriculum for basic 
schools and upper secondary schools). Regulation of the 
Government of the Republic of Estonia, RT I, 14.01.2011. 

[7] Bauer, M. W. (2012). The changing culture of science across 
old Europe: 1989-2005. In: M.W. Bauer, R. Shukla and N. 
Allum (Eds.). The culture of science: How the public relates 
to science across the globe. New York, NY: Routledge, 92- 
109. 

[8] Heller, K. A. (2007). Scientific ability and creativity. High 
Ability Studies, 18 (2), 209-234. 



Universal Journal of Educational Research 4(5): 1142-1147, 2016 


1147 


[9] Lee, H.; Yoo, J.; Choi, K.; Kim, S.-W.; Krajcik, J.; Herman, 
B. C. & Zeidler, D. L. (2013). Socio-scientific Issues as a 
Vehicle for Promoting Character and Values for Global 
Citizens. International Journal of Science Education, 35 (12), 
2079-2113. 

[10] Eastwood, J. L.; Sadler, T. D.; Sherwood, R. D. & Schlegel, D. 
M. (2013). Students’ Participation in an Interdisciplinary, 
Socio-scientific Issues Based Undergraduate Human Biology 
Major and Their Understanding of Scientific Inquiry. 
Research in Science Education, 43 (3), 1051-1078. 

[11] Sadler, D. T. (2005). Evolutionary theory as a guide to 
socioscientific decision-making. Journal of Biological 
Education, 39 (2), 68-72. 

[12] Lenz, L. & Willcox, M. K. (2012). Issue-Oriented Science: 
Using Socio-scientific Issues to Engage Biology Students. 
American Biology Teacher (University of California Press), 
74 (8), 551-557. 

[13] Sadler, D. T. (Ed.) (2011). Socio-scientific Issues in the 
Classroom Teaching, Learning and Research. Dordrecht: 
Springer Science+Business Media B.V. 


[14] Bellotti, F.; Bottino, R.M.; Femandez-Manjon, B. & Nadolski, 
R. (2014). Guest Editorial: Game Based Learning for 21st 
Century Transferable Skills: Challenges and Opportunities. 
Journal of Educational Technology & Society, 17 (1), 1-3. 

[15] Boyles, T. (2012). 21st Century Knowledge, Skills, and 
Abilities and Entrepreneurial Competencies: a Model for 
Undergraduate Entrepreneurship Education. Journal of 
Entrepreneurship Education, 15,41-56. 

[16] Zhou, S.; Han, J.; Koenig, K.; Raplinger, A.; Pi, Y.; Li, D.; 
Xiao, H.; Fu, Z. & Bao, L. (2016). Assessment of scientific 
reasoning: The effects of task context, data, and design on 
student reasoning in control of variables. Thinking Skills and 
Creativity, 19, 175-187. 

[17] Voogt, J. & Roblin, N.P. (2012). A comparative analysis of 
international frameworks for 21st century competences: 
Implications for national curriculum policies. Journal of 
Curriculum Studies, 44 (3), 299-321. 

[18] Social Science Statistics homepage. (2016). Cohen's D for 
T-Test (Independent Samples). URL: http://www.socscistatis 
tics.com/effectsize/Default3.aspx. 



